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Abstract — We exhibit two memoryless Gaussian networks 
where the capacity-gains afforded by feedback are unbounded 
in the signal-to-noise ratio (SNR). The networks are instances 
of the Gaussian broadcast channel and the two-user Gaussian 
interference channel. To demonstrate the capacity-gains we 
propose and analyze a novel feedback coding scheme. 

For the broadcast channel with two receivers it is shown that 
if the noise sequences at the two receivers are perfectly anticor- 
related, then, at high SNR, feedback asymptotically doubles the 
sum-capacity. The same holds if the noise sequences are perfectly 
correlated provided that they are of unequal variances. This 
result extends to the multi-receiver broadcast channel: if the 
noise sequences are all different and have a rank-one covariance 
matrix, then, at high-SNR, feedback asymptotically multiplies the 
sum-capacity by the number of receivers. However, as we show, 
these multiplicative gains collapse when the feedback is noisy. 

For the two-receiver Gaussian broadcast channel with noise- 
free feedback we also derive the high-SNR asymptotic sum- 
capacity. The expansion is exact in the sense that, as the SNR 
tends to infinity, the difference between the sum-capacity and our 
asymptotic expression tends to zero. If the noise sequences are 
perfectly anticorrelated or if they are perfectly correlated and 
of unequal variances, then the asymptotic expansion is as if the 
transmitter communicated to the two receivers over two parallel 
Gaussian channels. Otherwise, the asymptotic expansion is the 
same as if the receivers could cooperate. 

For the two-user interference channel it is shown that if the 
noises experienced by the two receivers are perfectly correlated 
or perfectly anticorrelated, then for most channel-gains feedback 
doubles the high SNR sum-capacity. 



I. Introduction 

We present two memoryless Gaussian networks where the 
capacity gains afforded by noise-free feedback are unbounded 
in the signal-to-noise ratio (SNR). The networks are instances 
of the real, scalar, additive white Gaussian noise (AWGN) 
broadcast channel (BC) and the real, scalar, AWGN interfer- 
ence channel (IC). 

For the two-user AWGN BC we prove that, when the 
AWGN sequences corrupting the outputs at the two receivers 
are perfectly anti-correlated (i.e, have correlation coefficient 
p z = — 1) or when they are perfectly correlated (i.e, p z = 1) 
and of unequal noise variances (a\ ^ erf), at high SNR, 
noise-free feedback approximately doubles the sum-capacity 
from | log (1 + SNR) to approximately 2 ■ \ log (1 + SNR). 
Thus, in these cases the noise-free feedback increases the sum- 
capacity by approximately ^ log(l+SNR) which is unbounded 
in the SNR. The same holds also even when the two AWGN 
sequences are sufficiently close to perfectly anticorrelated (i.e., 
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1+ sNr-*' or w hen they are sufficiently close to perfectly 
) and have different variances 



correlated (i.e., p z 
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In these cases the prelog (the factor in the sum-capacity 
high-SNR expansion in front of | log (1 + SNR)) is 2 and 
exceeds the number of transmit antennas. This is in sharp 
contrast to the case where the received signals are corrupted 
by independent AWGN sequences, a case in which the prelog 
(with or without feedback) cannot exceed the number of 
transmit (or receive) antennas (TJ. 

To demonstrate these gains we propose and analyze a novel 
feedback coding scheme, similar to the schemes in (4), 0, 
and [6|. (The gains for anti-correlated AWGN sequences are 
also achieved by the Ozarow-Leung scheme in (8), if 
the scheme's parameter are chosen carefully, see ifTol . fl"fl .) 
Our proposed coding scheme also allows us to determine 
the high-SNR asymptotics of the sum-capacity of the two- 
receiver AWGN BC with noise-free feedback and arbitrary 
noise correlation. The expansion is exact in the sense that the 
difference between it and the sum-capacity Cbc,s vanishes as 
the SNR tends to infinity: 

• When the two AWGN sequences are perfectly anticorre- 
lated (i.e, have correlation coefficient p z = — 1) or when 
they are perfectly correlated and have unequal variances 
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Thus, the sum-capacity approaches the sum-capacity of 
two parallel AWGN channels where the transmitter can 
communicate with power P over each of them. In this 
case, noise-free feedback doubles the prelog and thus 
provides gains in the sum-capacity that are unbounded 
in the SNR. 

When the AWGN sequences are neither perfectly anti- 
correlated nor perfectly correlated, 
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(2) 



and the sum-capacity approaches the sum-capacity of 
a setup where the two receivers can cooperate. Here 
feedback does not increase the prelog, and its benefit at 
high SNR is the additive term \ log ' "i+^p^i^ 



2 ^6 ^maxK^Xl-p?), 

This gain is bounded in the power, but it can be very 

1 The prelog is often also referred to as the multiplexing gain or degrees of 
freedom. 
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significant if p z is close to —1 or if it is close to 1 with 

For the K > 2 user AWGN BC our proposed coding scheme 
allows us to prove that if the AWGN sequences corrupting the 
K received signals are all different but have covariance matrix 
of rank 1, then a prelog of K is achievable. For a related recent 
result see lfl2l . 

A naturally ensuing question is whether these gains in 
capacity can also be attained when the feedback is noisy. In 
this paper we concentrate on how feedback noise affects the 
reported gains in the prelog. We show that when the feedback 
links are corrupted by independent AWGN sequences, then — 
irrespective of the positive feedback-noise variances and of 
the correlation of the forward noise-sequences — the prelog 
of the two-user AWGN BC setup equals one (as in the 
absence of feedback). The proof of this result is based on 
a genie argument inspired by the work of Kim, Lapidoth, and 
Weissman |[T3l . 

The second network we consider is the two-user scalar 
AWGN IC with noise-free one-sided feedback where each of 
the two transmitters communicates with a different intended 
receiver, and each transmitter observes feedback from its cor- 
responding receiver only. Our proposed coding scheme proves 
that when the two AWGN sequences experienced at the two 
receivers are perfectly anticorrelated or perfectly correlated, 
then for most channel gains noise-free feedback doubles the 
prelog from 1 to 2. Thus, noise-free feedback allows to 
approximately double the sum-capacity at high SNR and can 
provide unbounded gains. (When the interference channel is 
symmetric, the prelog 2 result can also be shown using a slight 
generalization (to account for the correlation between the noise 
sequences) of Kramer's memoryless LMMSE-scheme [14|.) 

Previously, a prelog of 2 was known to be achievable for 
the two-user scalar AWGN IC only when the two transmitters 
(or the two receivers) could fully cooperate |[T5l in the sense 
that both transmitters can compute their channel inputs as 
a function of both messages. Our result shows that limited 
cooperation through feedback can be sufficient. 

For the two-user AWGN IC we do not consider noisy 
feedback. Rate-limited feedback for this setup has recently 
been studied in [ 18 1. 

The fact that feedback can increase the capacity of memory- 
less networks without bounds was first reported by the authors 
in for the two-user AWGN BC and for the symmetric 
two-user AWGN IC where the individual noise sequences 
corrupting the outputs at the two receivers are perfectly anti- 
correlated. The same conclusion was later also reached in 0, 
[16 1 (also based on the scheme proposed in |17|) for the two- 
user AWGN IC when the noise sequences are independent. 
Multiplicative gains for the AWGN IC with independent noises 
at moderate SNR were already reported in 1 14 Section VI-B]. 

We conclude this section with some notation and an outline 
of the rest of the paper. Throughout the paper the logarithm is 
taken with respect to the base 2 and for convenience we define 
— logO = oo. We will use the shorthand notation log + (a;) for 
max{0, log(x)}. Also, we denote by A n and a n the tuple of 
random variables A\ , . . . , A„ and their realizations a\ , . . . , a n , 
respectively. The set of real numbers will be denoted by R, 
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Fig. 1. The two-user AWGN BC with noise-free feedback. 



the set of positive real numbers by and the set of positive 
integers by Z + . The abbreviation IID stands for independent 
and identically distributed. 

The paper is organized as follows. In Sections IHhVI we 
present the channel models and the main results for the 
two-user AWGN BC with noise-free feedback, the two-user 
AWGN BC with noisy feedback, the K > 2 user AWGN BC 
with noise-free feedback, and the two-user AWGN IC with 
one-sided noise-free feedback. In Section |VT] we present a 
coding scheme for the two-user AWGN BC with noise-free 
feedback, and prove our results for this setup. In Section IVHI 
we prove our results for the AWGN BC with noisy feedback. 
In Sections IVIIII and |IX] we present coding schemes and 
prove our results for the A'-user AWGN BC with noise-free 
feedback and the two-user AWGN IC with one-sided noise- 
free feedback, respectively. 

II. Two-User Broadcast Channel with Noise-Free 
Feedback: Setup and Main Results 

The real, scalar, AWGN BC with noise-free feedback is 
depicted in Figure Q] Denoting the time-t transmitted symbol 
by xt <E M and the time-i received symbols by Y\ t and Y 2it 
respectively, we have 



Y 



i.i 



and 



Y 9 



(3a) 



(3b) 



where the sequence of noise pairs {(Zi yt , Z 2 j)} is drawn IID 
according to a centered Gaussian distribution of covariance 
matrix 



K z = | ^ 

p z a X (j 2 



of p z o-ia 2 \ 



2 ) 



(4) 



We assume that both noise variances <t\,(j 2 are positive (i.e., 
not equal to 0). 

The transmitter wishes to send Message M\ to Receiver 1 
and an independent message M 2 to Receiver 2. The messages 
Mi and M 2 are assumed to be uniformly distributed over 
the sets Mi = {I, . . . , [2 nRl \} and M 2 = {1, ■ . • , [2 nR2 \}, 
where n denotes the blocklength and R\ and R 2 the respective 
rates of transmission. 

It is assumed that the transmitter has access to noise-free 
feedback from both receivers, i.e., that after sending Xt-i it 
learns both outputs Y^t-i and Y 2< t-i. The transmitter can 
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thus compute its time-i channel input as a function of both 
messages and all previous channel outputs: 



te{i, 



}, (5) 



(n) 

where the encoding function f% c t is of the form 

±\- M 1 xM 2 xR t - 1 



(6) 



The channel inputs are subject to an expected average block- 
power constraint P > 0. Thus, in (0 we only allow for 
encoding functions | f% c t j such that 



E* 2 



< p. 



(7) 



After the rt-th channel use each receiver decodes its intended 
message based on its observed channel output sequence. 
Receiver 1 produces the estimate 

0[ n) OT), (8) 



Mi 



and Receiver 2 the estimate 
M 2 = 
where the decoding functions 



and 



J"). 



r -> [2 nR2 \}. 



(9) 

are of the form 

(10) 
(11) 



A rate pair (Ri,R 2 ) is said to be achievable if for every 
block-length n there exists a set of n encoding functions 
{/bc\j as m © satisfying the power constraint (0 and 

and </>2™^ as in ( TTOb and (fTTT l such 



two decoding functions 
that 



lim Pr 



(M 1 ,M 2 )^(M 1 ,M 2 ) 



= 0. 



The closure of the set of all achievable rate pairs (Ri,R 2 ) 
is called the capacity region. The supremum of the sum 
Ri + R 2 over all achievable rate pairs (Ri,R 2 ) is called its 
sum-capacity, and we denote it by Cbc,e(-Pj cr\ , cf> Pz)- In 
this paper we are particularly interested in the prelog, which 
characterizes the logarithmic growth of the sum-capacity at 
high powers, and is defined as: 



jt— Cbc.y,{P,oI,oI,Pz 



P-S-oo 



log(l + P) 



(12) 



The sum-capacity of our setup Cbc,e is unknown except 
for the physically degraded case where 



p z &<—,— 



<7i (72 
02 ' (7i 



(13) 



In this case the capacity region is not increased with feedback 
lfT9l, and thus, |2<2, ED 



Cbc,e(-P, of, cr|, p 2 ) = i log 



1 



P 



mm{crf,af} 

The AWGN BC with feedback is in particular physically 
degraded if p z = 1 and erf = of, in which case both receivers 
observe exactly the same output sequence. 



Our main result in Theorem [T] is the asymptotic high-SNR 
sum-capacity of the AWGN BC with feedback. Whenever the 
BC is not physically degraded, the asymptotic high-SNR sum- 
capacity with feedback is strictly larger than without. 

Definition 1: Let CHi e hSNR(P °2! Pz) be defined as fol- 
lows. 

• For physically degraded channels, i.e., p z £ §7}' 

P 



C H ighSNR(-P, CTf , cr 2 , p z ) = - log 1 



min{cr^, ct|} 



(15) 



For not physically-degraded channels with fully corre- 
lated noises, i.e., \p z \ = 1 and p z <=£ jg-, 2a j, 



1 



P 



1 



P 



C H i g hSNR(-P, a\,al,p z ) = ^ log ^ + £ log . (16) 

Finally, for not physically degraded channels with par- 
tially correlated noises, i.e., p z £ (—1,1) and p z ^ 



CHighSNR (P, G\ , Cr 2 , Pz 



cr| - 2p z aia 2 ) 



1, 

2 10 H ofoi(l-^) 



(17) 



Theorem 1 (Asymptotic High-SNR Sum-Capacity): For all 
<j\,<j\ > and p z E [-1, 1] 

lim (C B c,s(-P, cri,cr|,p z ) - C H i g hSNR(P, Ci,ct|,p 2 )) =0. 

P— s-oo 

(18) 

Proof: When the channel is physically degraded, i.e., p z £ 
{ a! ' ff } ' resu l l follows from ( Tl4b . For the other cases the 
result is proved in Section IVI-CI ■ 
Note 1: If \p z \ — 1 and the channel is not physically 
degraded, the sum-capacity at high SNR is as if there was 
a separate, non-interfering link from the transmitter to each 
of the two receivers and the transmitter could communicate 
with power P over both these links. If p z £ (—1, 1), then the 
sum-capacity at high SNR is as if the two receivers could fully 
cooperate in their decoding. 



Note 2: Given o\,o\ > 0, define 7: (-1, 1) 



l(Pz) = 



a\ - 2p z a X (i 2 



(19) 



o\ol{\-p^ 

By Theorem Q] j(p z ) describes the behavior of the sum- 
capacity in the asymptotic high-SNR regime when p z £ 
(—1, 1). Notice that j(p z ) —> 00 as p z — > — 1, and if a\ 7^ of, 
then also j(p z ) — >■ 00 as p z +1. Moreover, j(p z ) is 
strictly decreasing over p z £ (— 1, min f^-> and strictly 

increasing over p z £ ^min , 1^- It thus takes its 

minimum at p z = min {a, a J where 7 (p,) = min{ ^^ } - 
Figure |2] shows the typical behavior of j(p z )- 



' ' ^ ' From Theorem Q] we obtain the following corollary. 



2 Notice that for physically degraded channels with partially correlated 
noises, i.e., for p z 6 (— 1, 1) and p z S cti'}' tne definitions in il5\ 

and (T7J coincide. 
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Fig. 2. 



The function 'y(pz) is plotted over p z £ [—0.9,0.95] for a\ = 1 
and cr| = 0.25. The minimum is at \/l/8 ~ 0.3536, and the function is 
strictly decreasing over ( — 1 , ^/l/8) and strictly increasing over ( l) ■ 
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Fig. 3. The sum-rate R^(P) achieved by the scheme in Section TVI-AI 
normalized by i log(l + is plotted as a function of the power 

P > 0. The noise variances cj 1 = cr| = 1 are fixed, and the different 
curves correspond (in increasing order) to correlation coefficients p z = 
-0.85, -0.95, -0.99, -0.999 - 0.9999. 



Corollary 2 (Prelog): The prelog of the AWGN BC with 
noise-free feedback is 2 if p z = — 1 or if p z = +1 and a\ ^ 
a\, otherwise it is 1. 

Note 3: Our results for p z E { — 1,1} remain valid when 
the transmitter has only one-sided noise-free feedback, i.e., 
when the transmitter for example only observes the outputs 
{Yi,t} but not {Y2,t}- This holds because for p z £ { — 1, 1} 
the capacity regions with one-sided and two-sided feedback 
coincide. In fact, in the setup with one-sided feedback the 
transmitter can locally compute the missing outputs Y 2 ,t (or 
Yi, t ): 



Y 2 , t = Pz — (Yi, t 



X t )+X t , te{l,...,n}. 



Theorem Q] and Corollary |2] show that when p z 6 { — 1,1} 
and the channel is not physically degraded, feedback approx- 
imately doubles the high-SNR sum-capacity. In Section [VI-AI 
we present a coding scheme with this desired performance. 
(When p z = — 1 also the Ozarow-Leung scheme 0, (9) 
achieves such sum-rates iflOl . (TT|.) In Figure [3] we have 
plotted the relationship between the sum-rate achieved by our 
scheme in Section IVI-AI and the transmitted power P for 
various values of the correlation p z . It shows that for large 
powers P (i.e., P > 100), feedback can nearly double the 
capacity not only when the correlation p z is exactly -1, but 
also when p z is sufficiently close to -1, (i.e., when p z = — 1 + e 
for sufficiently small e > depending on the power P). The 



same observation can be made when p z = 1 — e if a\ ^ u\. 

Theorem [3] and Corollary [4] ahead explore the relationship 
between P and the required correlation p z . Since the required 
correlation depends on the transmit power P, we make the 
dependence explicit and denote the correlation by p z (P). 
Theorem [5] and Corollary @] thus characterize the generalized 
prelog where the channel parameters (here the noise correla- 
tion p z ) vary with the power P. 

Let noise variances a\ , a\ > and for each power P > 
a correlation coefficients p z (P) be given. Define 



a ee -ipg(i + P,(P» 

S P^oo l0g(P) 

A -log(l-p,(P)) 
C+i = hm : — t—, . 

S+ P^co l0g(P) 



(20) 



(21) 



where recall that we defined — logO = oo. Notice that 
C-i > only if \im P _^ c p?(P) = — 1, and C+i > only 
if limp^oo p z {P) = 1. 

Theorem 3 (Generalized Prelog): The generalized prelog 
depends on whether the noise variances a\ , cr| > are equal 
or different. If of = erf, the generalized prelog is 



hm — = mm { 1 + C- 1 , 2} . (22) 

P^oo i log(l + P) 



and if u\ ^ erf, it is 

— C B c, s (P^,a 2 2 ,P,(P)) 

P^o I log(l + P) 

= min{l + max{C-i,C+i},2}. (23) 

Proof: See Section IVTCl ■ 
Corollary 4 {Generalized Prelog): Let p z (P) be of the 
form 



± 1 



e(P) 
PC 



ve {1,2}, Ce [0,1] 



where 



■i m b «(f» = o. 

P^oo log(P) 

Unless o\ = cr\ and limp-j.oo p z (P) = 1, 

C BC , S (P,^ !( T 2 2 ,P Z (P)) _ 



lim 

P->oo 



5 log(l + P) 



i + C 



(24) 



III. 



Two-User Broadcast Channel with Noisy 
Feedback: Setup and Results 



In this section we study the AWGN BC with noisy feedback, 
which is depicted in Figure |4] The goal of the communication 
is the same as in the previous section. That is, the transmitter 
wishes to convey Message Mi to Receiver 1 and Message 
Mi to Receiver 2 by communicating over the AWGN BC 
described in (01. The transmitter has access to noisy feedback. 
Thus, instead of observing the channel outputs Y\ t an d Y2,t as 
in the previous section, it observes the noisy feedback outputs 
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Fig. 4. The two-user AWGN BC with noisy feedback. 



The feedback-noise sequences {(Wi,{, W2,t)} are assumed 
to be independent of the messages (Mi,M 2 ) and of the 
noise sequences on the forward path {{Zi t t, Z 2 ,t)} and IID 
according to a zero-mean bivariate Gaussian distribution of 



diagonal covariance matrix ( <T ^ 1 







W2 



We shall assume 



throughout this section that the feedback noise variances are 
positive 

cr wl ,a W2 > 0. (25) 



In this setup the transmitter computes its channel inputs as 

(26) 



Xt = /^cLs y , t (Mi, M a , Vt^ Vt 1 ) , t e {1, . . . , n}, 



where the encoding function f^ Noisy t is of the form 



JBCNoisy.t ' 



Mi x M 2 x M t_1 X K*" 1 



(27) 



The channel input sequence (Xi, . . . ,X n ) is again subject 
to an expected average block-power constraint P > as in 
©. 

Decoding rules, achievable rates, capacity region, sum- 
capacity and prelog are defined as in the previous section. The 
sum-capacity for this setup with noisy feedback is denoted by 
CBCNoisy,s(-P, o~ x ,a 2 ,p z , <7wn a W2)- 

Noisy feedback does not increase the prelog. 

Theorem 5: Irrespective of the correlation p z e [—1,1], the 
prelog is one: 



lim 

P->oo 



CBCNoisy,s(-P, Ol, 0~ 2 ,p z , 0~ wl , (T W2 i 



ilog(l + P) 



(28) 



Proof: See Section [VI] ■ 
Thus, with noisy feedback the prelog equals 1 also when the 
noise correlation p z € { — 1, 1}. This result assumes that the 
feedback-noise variances cr^ vl ,a^ V2 > are fixed- If instead 
they tend to as the power P — > oo, then for p z E {—1,1} 
the (generalized) prelog may be larger than 1, depending 
on the speed of convergence of the limits Owii a W2 0. 
The following note examines the generalized prelog when the 
feedback-noise variances tend to slower than P~^ for any 

£>o. 

Note 4: Theorem [5] remains valid if the feedback-noise 
variances <Jwi' a W2 tenc l to as the power P oo, if the 

3 For simplicity, we do not treat setups with correlated feedback noises or 
setups with feedback noises that are correlated with the forward noises. 



convergence is slower than P * for all £ > 0. More precisely, 
if cryy i, &w 2 depend on P in a way that 



lim 

P^oo l0g(P) 



<0, ^€{1,2}, 



then the prelog is 1, irrespective of the noise correlation p z g 
[-1,1]. 

Proof: See Section [VlTBl ■ 

IV. if -User Broadcast Channel with Noise-Free 
Feedback: Setup and Main Results 

We generalize the setup in Section [II] to K > 2 users. 
Thus, here, the single transmitter wishes to communicate with 
K receivers. The goal of the communication is that each 
Receiver k 6 {1, ...,K} learns its desired Message Mk, 
where the messages Mi , . . . , Mk are independent, and each 
Mk is uniformly distributed over Mk ={!,.■■ , \ 2 nRk \}. 

The channel model is described as follows. Given that 
the transmitter sends the time-t input symbol xt, Receiver k 
observes the time-t output symbol 



Yk,t = x t + Z k ,t, te {1, ...,n}, 



(29) 



where {(Zi,t, . . . , ZK,t)Yt=i i s a sequence of IID centered 
Gaussian vectors of covariance matrix K z and independent of 
the messages (Mi, . . . , Mk)- 

The transmitter has noise-free feedback from all channel 
outputs, and thus can compute its channel inputs as 



Xt = f£L t (Mi, • . • , M K , Yt\ 



K 



(n) 

for some encoding function f^ c t , such that the input se- 
quence (Xi, . . . ,X n ) satisfies the expected average block- 
power constraint in ©. 

An error occurs in the communication whenever 



(Mi,...,M K ) ^ (Mi, . 



,M, 



K) 



(30) 



Achievable rate-tuples, capacity region, and sum-capacity are 
defined in analogy to the setup with two users. The sum- 
capacity of this setup is denoted by Ck-bc,e(-P, K z ). We are 
interested in its prelog. 

Theorem 6: If the covariance matrix K 2 has rank 1, then 
the prelog is 

cWs(p,k z ) 



lim 



log(l + P) 



(31) 



where n a denotes the number of rows in K z that are different. 
Proof: See Section [VIlFB] ■ 

Corollary 7: When K z is of rank 1 and all its rows are 
different, the prelog is K. 

The achievability of prelog K > 3 was first proved in lfT2l 
for the complex memoryless Gaussian broadcast channel. The 
prelog > 3 result in lfl2ll however requires that the real and 
imaginary parts of the noise symbols are correlated, and thus 
does not include our result in Theorem [6] as a special case. 

Note 5: Theorem [6] remains valid also when the transmitter 
has feedback only from a single receiver. This can be seen by 
analogy to Note [3] 
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V. Two-User Interference Channel with 
Noise-Free Feedback: Setup and Main Results 

In this section we consider the real scalar AWGN IC with 
noise-free feedback, which has two transmitters. Transmitter 1 
wishes to send Message Mi to Receiver 1, and Transmitter 2 
Message M2 to Receiver 2. Assuming that at time t Transmit- 
ter 1 sends the real symbol x\ : t and Transmitter 2 sends the 
real symbol x 2 u Receiver 1 observes 



and Receiver 2 observes 

Y 2 ,t = a2,ixi,t + a 2 ^2,t + Z 2 ,t- 
The "channel gains" 

01,1,01,2102,1,02,2 7^ 0, 



(32a) 

(32b) 

(33) 
sequences 



are non-zero real constants and the noise 
{(Zij, ^2,*)}r=i are defined as in Section [TT1 

Each transmitter has access to noise-free feedback from its 
corresponding receiver. Thus, each of the two transmitters can 
compute its time-/; channel input as 



X 



k.t 



f(") (Mi, Y^ 1 



for some encoding function / IC 

f&L-.MkxR*- 1 



(n) 



k.t 



fee {1,2}, 

of the form 

I, ^e{i,2}. 



The two channel input sequences are subject to the same 
average block-power constraint P > 0: 



1 



£*2, 



<P, fee {1,2}. 



(34) 



Decoding rules, achievable rate pairs, capacity region, sum- 
capacity, and prelog are defined as for the AWGN BC. We 
denote the sum-capacity of the symmetric AWGN IC by 

Without feedback, the prelog of the AWGN IC equals 1; 
with noise-free feedback it can be 2, depending on the channel 
gains ai i, ai ^, 02,1, 02,2 7^ and on the noise parameters 
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01,02, Pz- 

Theorem 8: The prelog of the AWGN IC with noise-free 
feedback satisfies the following three statements. 

Q2.2 Ql,2 

Ol.l 



If p z G (-1,1) or if Pz e {-1,1} and g2 



£3 

: <Tl' 



lim 



\ log(l + P) 



(35) 



if Pz G { — 1,1} and moreover, both and are 
different from p z ^, then 

C IC ,s(P,(rf,a^,p z ) _ 



lim 

P->oo 



|log(l + P) 



otherwise 



1 < lim \ P ' lJ 21 H ' < 2. 
" P^oo I log(l + P) 



(36) 



(37) 



VI. A Scheme and Proofs for the AWGN BC with 
Noise-Free Feedback 

A. A coding scheme 

We present a new coding scheme for the K = 2 user 
Gaussian BC with noise-free feedback, see also Q- (The 
scheme is generalized to K > 2 users in Section IVIII-AI ) 
Our scheme is similar to the schemes proposed by Cover and 
Pombra [4] for (non-white) Gaussian point-to-point channels 
with noise-free feedback, by Lapidoth and Wigger for the 
two-user AWGN multi-access channel with noisy feedback, 
and by Lapidoth, Steinberg, and Wigger ||6] for the two- 
user AWGN BC with one-sided noise-free feedback. We also 
propose a choice of parameters for our scheme. Despite being 
suboptimal (see [7| for improved choices), this choice suffices 
to prove the achievability results in Theorems Q] and [3] when 
the channel is not physically degraded. 

Our scheme has the following parameters: the positive 
integer number 77; the r]-by-r] strictly lower-triangular matrices 
Bi, B2; the ?7-dimensional column-vectors 111,112; and the r\- 
dimensional row-vectors vi,V2. 

1) Code Construction: Let the block-length n of our 
scheme be a multiple of 77, i.e., n = rjn' for some positive 
integer number n'. 

We generate two codebooks {Cfc}^ =1 , where Ck contains 
y<2 nR >' J codewords of length n' . To generate the codebooks 
we draw each entry of each codeword randomly and inde- 
pendently according to a standard Gaussian distribution. Both 
codebooks are revealed to the transmitter, and each codebook 
Ck to the corresponding receiver k. 

2) Encoding: For k € {1,2}, let Sk(Mk) denote the 
codeword in Ck that corresponds to Message Mfc, and let 

be its i-th symbol. 

Also, for each i e {1, ... ,n'} let X; denote the r7-length 
column vector obtained by stacking the 77 input symbols 



X^-i),^!, . . . , Xriri on top of each other: 

X; = (X(j_i)^_|_i, . . . , X( irl )) T , 



(38) 



and for each k e {1, 2}, let the 77-length vectors Yj. j and 
be defined similarly. 

The encoding procedure is as follows. The transmitter picks 
from each codebook Ck, for k £ {1,2}, the codeword that 
corresponds to the message Mk, and then sends in each 
subblock i £ {l,...,7i'} a linear combination of the i-th 
symbols of these codewords and the subblock's past noise- 
symbol^ 



Xj — Swiii + S2 iU2 + BiZi.j + B2Z 



2.c 



(39) 



Proof: See Section HX-Bl 



The strict lower-triangularity of the matrices Bi and B2 assures 
that the feedback is used only causally. 

The inputs satisfy the average block-power constraint (0 
whenever Inequality ( f40b on top of the next page is satisfied. 

4 The transmitter can compute all the past noise symbols because, through 
the feedback, it learns the past channel outputs and because it also knows the 
past channel inputs. 
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|u 2 || 2 +tr(B 1 B T 1 )(j2 +tr (B 2 B T 2 )o-2 + 2tr(BiB T 2 )p z f7iCT 2 < r\P. 



(40) 



3) Decoding: In subblock i G {1, ...,n'} Receiver 1 
observes 



Yi,i — Sl,iUx + ^2,iU2 - 

and Receiver 2 observes 

Y2 A = Si jUl + ^2,iU2 



(B 1 + l)Z 1 , i + B 2 Z 2 



(41a) 



(B 2 + I) Z 2li + B X Z M . (41b) 



To decode its desired message M/-, each Receiver fc G {1, 2} 
forms the "new outputs" 



i G {l,...,n'}, 



(42) 
e.g., 



and optimally decodes based on (i/^x 
using a maximum-likelihood decoder. 

4) Choice of Parameters: We describe a choice of the 
parameters Bi,B2, Ui,U2, Vi,v 2 for every positive integer 
ij, and then let r\ 00. 

Choose q > and S ^ { — 1,0} to satisfy Equation (l43l l 
shown on top of the next page, and define 



A 

a\= q 



A (-2 

a2 = —0 q 
b 1 ^-S(l + 5)q 2 
b 2 ^-S 2 (l + S)q 2 . 



(44) 
(45) 
(46) 
(47) 



For a given positive integer 77 we choose the 77 x 77 matrices 
Bx and B 2 Toeplitz with non-zero entries only on the first and 
second diagonals below the main diagonal: 



/o 





































b k 


a-k 



















bk 


(Ik 








































a-k 


0/ 



(48) 



and we choose the 77-dimensional vectors 
a, = r-H ^ 



\ 



2 + 2- 







u 2 



\ 



2 + 2 



hi 



(l ^ 











vi = 



v 2 



((-tr (-*) 



77-1 



•7-2 
•7-2 



.62 

«2 



111 



(49a) 

(49b) 

(49c) 
(49d) 



By (|43j-((48j, for every 77 this choice satisfies the power 
constraint d40l ). Moreover, the vector Vx is orthogonal to the 
first 77 — 2 columns of the matrices (Bx + I) and B 2 , and to 
the vector U2, but not to ui. Similarly, V2 is orthogonal to the 



first 77 — 2 columns of the matrices Bx and (B 2 + I), and to 
the vector Ui, but not to 112. Therefore, 



h. 



\ 



2 + 2 ^ 
b 2 



«2 



1 _ -ib. 1 - 

b 2 ai 



h ai Z\,ir)-\ + Zi t i V + a 2 Z 2 ,iri-i (50a) 

Ct2 



h,i = 



\ 



P 



2 + 2 
61 



h 

a 1 



77-1 



1 - -, ^2,j 

01 a 2/ 



h a 2 I ^2.j))-l + ^2,j)) + Q>lZl,ir]-l- (50b) 

ai 



We see that with our choice of parameters the last 77 — 2 
channel uses in each subblock are used to iteratively can- 
cel the previous noise symbols in this subblock. Therefore, 
the "new output symbols" Ixj or 7 2i j depend only on the 
noise symbols Zxi^-i, Zx t in, Z 2 ^-x, -^2,777 but not on the 
previous noise symbols. Also, Receiver l's "new outputs" 
ix,x, • • • 7 Ii,n> do not depend on the non-desired codeword 
S 2 x, • ■ • , S 2 n /, and thus they can be viewed as the outputs of 
a point-to-point channel where the transmitter only sends the 
codeword Hx,x, . . . , Hx, n ', but not E 2 ,x, • • • , San'. Similarly 
for Receiver 2's "new outputs". 

5) Achievable Rates: By (l44l- (|49d| i and d50j and by stan- 
dard arguments, our scheme achieves all rate pairs (Ri,R 2 ) 
that satisfy 



i?x<^log 



i?2 < 7^ log 

2r7 



(q 2 S 2 + l)a 2 



q 2 8 i a 2 



P(X + l/<5 2 ) 2 



(q 2 S 2 (l + S) 



2 

2V' _ 



{q 2 5 2 



q 2 a 2 



(51a) 



(51b) 



We have the following lemma. 

Lemma 1: Let £, ( be positive real numbers. If 1 + ( > 
£, then the mapping 77 G Z + H> log(l + C* 7 C), has its 
maximum at 77 = 1; otherwise it has its supremum at 77 — > 00. 

Proof: See Appendix lAl ■ 
By Lemma [TJ 77 = 1 maximizes the constraints in (BIT ) for 
small powers P and 77 — > 00 maximizes them for large powers 
P. Letting 77 — > 00, we conclude the following. 

Proposition 9: All nonnegative rate-pairs (Ri,R 2 ) that sat- 
isfy 



i?x<ilog+ (q 2 (l + S) 2 ) 
i?2<ilog + (q 2 S 2 (l + 5) 2 ), 



(52a) 
(52b) 



for some S ^ { — 1,0} and q such that d43l l holds, are 
achievable. 
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q 2 {a\ + S 4 a 2 2 - 2S 2 p z cr 1 a 2 ) + q\l + S) 2 S 2 (a 2 + 6 2 a\ + 28p z o 1 o 2 ) < P. 



(43) 



When p z {P) € (-1,1), the choice 

(72 <J 2 



9 2 = 



(l-e)P 



(53a) 
(53b) 



i 5 2 (l + ^) 2 ( CT 2 + ( 52 (7 2 + 2 ^ (7i(T2) 

satisfies the power constraint d43l for all e > and all powers 
P exceeding some threshold Po(e, u\ , u\ , p z ). Plugging this 
choice into the achievable rates in Proposition [9] results in the 
following corollary. 

Corollary 10: For p z E (—1, 1) and every e G (0, 1) there 
exists a positive real number Pq(c, a 2 , a 2 , p z ) such that the 
sum-rate 



Rx + R2 = \ log 4 



(l-e)P(a 2 +a 2 -2p z a 1 a 2 ) 



a 2 a 2 (l 



P z 

r 2 „2 



is achievable for all powers P > Po(e, af, <r|, p z ). 
When \p z \ — 1, the choice 

°i 



(72 



p 



(54) 

(55a) 
(55b) 



satisfies d43l . and the matrices Bi and B2 defined through 
(|44T>— (|48T> and d55j satisfy 



Bicri + B 2 p z a 2 = B, 



(56) 



where B is a Toeplitz matrix with all zero entries except on 
the first diagonal below the main diagonal where the entries 
equal VP'- 

( ••• 
/P ■■• 

VP ••• 00 



B 





V 



POO 

VP J 



(57) 



Since p z E { — 1,1} this implies that — similarly to the scheme 
for the AWGN point-to-point channel with feedback sketched 
in Note [7] ahead — in each channel use the transmitter only 
sends the previous noise symbol, but not the ones before. This 
is unlike our scheme for p z € (—1,1) where the transmitter 
sends the two previous noise symbols. 

Specializing the rate constraints in (IBTl l to the choice in (EBT l 
results in 



a<ii»g 1 



n-i 



7,-1 



1-A 



P/a 2 



a 2 J 2 + 2P/4 



(58a) 



1 U2 
1 - p z — 



P/4 



2 + 2P/a\ ) ' 
(58b) 



Letting 77 — > 00 we thus obtain the following corollary for 
|p*l = l. 

Corollary 11: If |p z | = 1, and the channel is not physically 
degraded, i.e., p z ^ |> men a ^ nonnegative rate-pairs 

(Ri,R 2 ) that satisfy 



Pi < \ log 4 



P 2 < 2 lo § 



P 



P 



(59a) 



(59b) 



are achievable. 
Note 6: For \p z 



= 1 and when the channel is not physically 



degraded our scheme achieves prelog 2 when r\ — > 00. For 
finite 77 our scheme achieves prelog 2^—!-, see d58l . Thus, 



7] = 3 suffices to increase the prelog compared to the non- 
feedback setup. 

Note 7: To gain intuition about the scheme and our choice 
of parameters, it is instructive to consider the following scheme 
for the AWGN point-to-point channel with feedback. We 
consider an AWGN channel with noise variance a 2 and power 
constraint P. The scheme is obtained by specializing our BC- 
scheme to K = 1. We describe our choice of parameters 
through an explicit description of the encoding and decoding 
strategies. 

Let Si, ... , S„/ denote the symbols of the single codeword 
chosen by the transmitter. In the first channel use of each 
subblock i E {1, ... ,71'} the transmitter sends the codeword 
symbol Sj scaled by VP, and in all other channel uses of the 

subblock it sends the previous noise symbol scaled by 



X 



(i-l)r,+l 



X 



(i-l)r7+2 



Xj, 





(60) 
(61) 

(62) 



where Z t denotes the Gaussian noise symbol corrupting the 
output at time t. The receiver uses the last r)— 1 channel outputs 
of each subblock to iteratively cancel the noise corrupting the 
first output in the subblock 




(i-l)ri+e 




n-i 



(63) 



and then decodes its desired message M by applying 
a maximum-likelihood decoder to the resulting sequence 
I\ , . . . , Letting ij — > 00, the described scheme achieves 
all rates satisfying 

1. +(P_ 

r'2 



< R < - log 



(64) 



and is thus optimal in the asymptotic high-SNR regime. 
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Notice that for finite 77 the performance of the scheme could 
be improved, if instead of as in do*3l the symbol Ii is chosen 
as the linear minimum-mean square estimate (LMMSE) of Ej 
given {i?i-iijj+^}7=i- However, in the limit 77 — > 00 both 
choices achieve the same rates. 

Note 8: The simple scheme in Note [7] illustrates that with 
feedback one can achieve a rate R = ~ log + (^-) over an 
AWGN point-to-point channel by sending most of the time — 
in fact, in all channel uses except for the first channel use of 
each subblock — the previous noise-symbol scaled to satisfy 
the power constraint P. 

Now, in our scheme for the AWGN BC with noise correla- 
tion \p z \ = 1 we apply the same idea with the only difference 
that we wish to convey two different codewords (one for 
each receiver) and that we send their corresponding symbols 
over the first two channel uses of each subblock. Sending the 
codesymbols during two channel uses allows us to choose 
their signaling directions (ui and 112, respectively) orthogonal 
to the beamforming direction at their non-intended receiver 
(V2 and vi, respectively). When the channel is not physically 
degraded, the beamforming directions at the two receivers 
are different, and each receiver observes essentially the same 
channel outputs as if the transmitter was using the point-to- 
point scheme in Note [7] Therefore, in this case, our scheme 
achieves the rate pair i?i = 1 log + (js-J> R2 = § log + (jp 
(see Corollary [TTTi. 

The special case \p z \ = 1 illustrates very nicely that the 
intuition put forth in [23] , [|9l , 11241 . 11251 applies also to our 
scheme: feedback is helpful for a memoryless BC because it 
allows the transmitter to identify and transmit information that 
at the same time is useful for both receivers, and therefore the 
BC can be used in a more efficient way. 



B. Proof of Theorem [7J 

For physically degraded channels where p z S 1 2a , 2i j the 
result is proved in Ifl9l and |2"01 . 

When \p z \ = 1 and p z £ |^-,|^|, the achievability 
follows from Corollary Q~T] and the converse by applying the 
cutset bound with two individual cuts between the transmitter 
and each of the two receivers: 

Ri+R 2 < max {I(X; Yi) + I(X; Y 2 )} 

~ X: E[X 2 ]<P 

— - log 

2 e 

where the equality follows because a Gaussian law maximizes 
the differential entropy under a variance constraint ll22l . 

When p z G (-1,1) and p z (£ the achievability 

follows from Corollary [10] and the converse by applying the 
cutset bound with a single cut between the transmitter and 
both receivers: 

i?i+P 2 < max I(X;Yx,Y 2 ) 

X: E[X 2 ]<P 

2 v n<^0--n) ) 



C. Proof of Theorem \3\ 

Recall that here p z (P) depends on the power P. 
We first prove the converse to ( f22l where a\ — a\. In this 
case, Upper bound do*6*b specializes to 

C BC ,^(P,alalp z (P)) 



< 5 Iog 1 



P 



, p,(P)€(-l,l).(67) 



In view of (TT~4-b and since we defined — log(O) = 00, Upper 
bound ( f6Tb holds also for p z {P) G { — 1, 1}, and thus for all 
p z {P) € [—1,1], Therefore, by the definition of £_i in 



C^(P,ai,ai, P (P)) < 

P^oo Il0g(l+P) 



(68) 



On the other hand, by (1531 ), irrespective of { P z(P)}{p>o}> 

(69) 



C BC MP,alalp z (P)) <2 _ 

1 - 

2 



r!og(l + P) 

Combining d68l l and d69l establishes the converse to d22l . 

We now prove the converse to (l23l l where a\ ^ <j\. By 
Upper bound (l66l l and since a\ + a\ — 2p z (P)a\a2 < 2(crf + 
a\) and 1 - p 2 z (P) > 1 - \p z {P)\ for all p z (P) e (-1, 1), 



C BC ^{P^i,a z 2 ,p z (P)) 
< I log j I 



P 




5(^(1 -MP)\) 



Now, since we defined — log(O) = 00, Upper bound d70b holds 
also for p z {P) G {-1, 1}, and hence for all p z {P) € [-1, 1]. 
Moreover, since by the definitions of £_i and ( + i in (f20]l and 
dZB, 

-log(l- |p (P)i) =ma3c 

P^oo lOg(P) 

we conclude that 



lim 

P-HXS 



■log(l + P) 



< l + max{C_i,C+i}- (72) 



Combining ( f72l with j69l establishes the converse to d23T i. 
We next prove that for arbitrary <r\ , cr|: 

C BC , S (Paf, C rf, ft (P)) 



lim 









P^oo 




+ iiog(n 




, (65) 








Since a 



|log(l + P) 



> min{l + C-i,2}. (73) 



feedback |20|, |21| the interesting case is £-1 > 0. In the 
following, assume that f_i > 0, which implies the existence 
of an increasing unbounded sequence {Pe}fLi sucn mat 



lim -log(l + ^)) =c _ i>0; 



and in particular 



|log(P^ 



lim p z (Pi) 

l— >oo 



-1. 



(74) 



(75) 



For each I we choose parameters qg and 5p and show that 
Inequality ( f73l follows from Proposition[9] specialized to these 
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parameters. Let e G (0,1) be a small positive number, and 
define the limit (not necessarily finite) 



K = lim P e (af + b\a\ + 2S e p z (P i ) ( x 1 a 2 ) . (76) 



We choose 



-P,(P<. 



if P,(^)G{-1,1}, 



(77) 



and depending on k, we choose > as follows. 
• If k = oo, we choose qe > such that 



(1 - *)Pt 



Hli y 5f (1 + 8 t )* [a\ + ofo, 2 + 2 Pz (P e )S e a 1 a 2 ) ' 

(78) 

if k G [0, oo), we choose qe > such that 

q] = 0(1 - e)P e 



where (3 > is a solution to 

, 2 

Ol 



^ U + f /5 1 + K =1 



(79) 



(80) 



°"2y \ "2. 
Notice that for any e > there exists a positive integer 
£o[e, a\,a 2 , k) such that our choice [St, qe) satisfies the power 
constraint (l43l for all £ > £o(e, a\ , of, k). 

Moreover, if k G [0, oo), then specializing the rates in 
Proposition [9] to the choices in (TTTb and d79l proves that 



£->oo 



log(l + Pi) 



(81) 



If k = oo, then for all sufficiently large £ the correlation 
coefficient p z (Pe) G (— 1, 1), and by ( TTTb the choice in (1781 
evaluates to 

2 = / (02-0lP,(^)) 2 ~ 

qe V of (1 + <5,) 2 a 2 (o 2 + a 2 - 2p z (P e )a 1 a 2 ) (1 + |p,(P/)|) 



03 by lim^oo = 1, and @ by 

^-sH 1 ^)^ ,s7) 

The assumption of non-equal noise variances a\ ^ a\ is 
needed here to conclude that (l83l holds and that d87b has a 
finite solution for f3. 

Combining finally ( 1851 with ( l73l establishes the achievabil- 
ity of $2% and d23l and concludes the proof. 

VII. Proofs for the AWGN BC with Noisy Feedback 

A. Proof of Theorem [5] 

The interesting part is the converse result, which we prove 
using a genie-argument similar to |[T3l . 

The following three steps establish the desired converse 
result. 1.) We introduce a genie-aided AWGN BC without 
feedback and show that its sum-capacity upper bounds the 
sum-capacity of the original AWGN BC with noisy feedback. 
2.) We introduce a less noisy AWGN BC with neither genie- 
information nor feedback and show that its sum-capacity coin- 
cides with the sum-capacity of the genie-aided AWGN BC. 3.) 
We show that the prelog of the less noisy AWGN BC equals 
1, irrespective of the noise variances af,a 2 l i a 'wi> <J W2 - > 
and the correlation coefficient p z G [—1,1]. 

We elaborate on these three steps starting with the first 
one. The genie-aided AWGN BC is defined as the original 
AWGN BC without feedback, but with a genie that prior to 
transmission reveals the sequences {(^i,t + Wi,t)}r=i and 
{(^2,t+l / ^2.t)}™ = i to the transmitter and both receivers. Notice 
that with this genie information, after each channel use t, the 
transmitter can locally compute the missing feedback outputs 
. V\,t and Vo t : 



(1 - e)P e 



Via =X t + {ZiA + W 1>t ), 
V 2>t =X t + (Z 2 a + W 2 ,t). 



(88) 
(89) 



V 1 - \P*(P)\ 

Notice that by {73) 
log 



(82) 



Sj(l+6 e ) 2 al[al+al-2p z (P e )a 1 a 2 )(l+\p z (P e )\) 

lim — — — — = 0, 



We can thus conclude that the sum-capacity of the genie-aided 
AWGN BC is at least as large as the sum-capacity of the 
original AWGN BC with feedback. 

We next elaborate on the second step. The less noisy AWGN 
BC is described by the channel law 



|log(P) 



(83) 

and therefore, specializing the rates in Proposition [9] to the 
choice in ( 1771 1 and (l82l proves that 

«-►<» ±log(l + P,) 

Combining ([84) with (EB establishes d73l . 

In a similar way we can also prove that when a\ ^ o\ 

t. C B c,s(P,o 2 ,o|,p4P)) . 

lim - td\ ^ mm {1 + C+i , 2} . (85) 

P^oo i log(l + P) 

To this end, it suffices if in the proof to ( 1731 we replace £_i 
by C+i, (CD by 

-W-^)) = C+1 > o, ( 86 ) 



Y(a = x t + Z' 



Y' 
X 2A 



x t + Z' 2t , 



(90) 
(91) 



where the noise sequences are defined as 

Z' l t 4 Z u - E[Z ltt \{Z u + W ltt ), (Z 2 a + W 2}t )] , (92) 
Z' 2 t 4 Z 2it - E[Z 2 , t \{ZiA + Wia), [Z 2d + W 2 a)} , (93) 
and are of variances 



Var(Zi, t ) = a\ 



a W\ a W2 



2 a{(l-pi)+a 



W2 U W1 



\l*r(7' \ - rr 2 W2 



(94) 



(95) 



By the following two observations, the sum-capacity of this 
less noisy AWGN BC coincides with the sum-capacity of 
the genie-aided AWGN BC. Firstly, the sum-capacity of 



11 



the less noisy AWGN BC remains unchanged if prior to 
transmission a genie reveals the sequences {Z\ :t + Wi t t} 
and {Z2.t + W2,t} to the transmitter and both receivers. 
This follows because by Definitions (|92l i and d93T > and the 
Gaussianity of all involved sequences the genie-information 
{Z-lj + Wij} and {^j + W^^} is independent of the reduced 
noise sequences {Z' lt ,Z' 2t }, and thus plays only the role 
of common randomness which does not increase capacity. 
Secondly, the sum-capacity of the genie-aided AWGN BC 
coincides with the sum-capacity of the less noisy AWGN BC, 
when in this latter case the transmitter and both receivers 
additionally know the genie-information {(Zi,t + Wi,t)} and 
{(Z2.t + W2,t)}- This holds because knowing the genie- 
information {(Zi, t + W^tWU and {(Za,t + W % t)}t=i the 
outputs Y[ t and Y 2t can be transformed into the outputs Y\ tt 
and Yz.t, and vice versa. 

We finally elaborate on the third step. The less noisy AWGN 
BC is a classical AWGN BC with neither feedback nor genie- 
information, and its sum-capacity is ll20l 



CBCLessNoisy,£(-P, CT 1 , 0~ 2 > Pz > a Wl ) ° W2J 

= 2 log ( 1 + min{Var(zy ,Var(zy} 



(96) 



where the variances Var(Z( t ) , Var(Z 2 t ) are defined in 
d94l and (|95]l. By d94j — the prelog of the less noisy 
AWGN BC equals 1, irrespective of the noise variances 

crf,a 2 ,a 2 vl ,a^ V2 > an d me noise correlation p z G [—1,1]. 
This concludes the third step, and thus our proof. 



B. Proof of Note® 

Let <j\,<j\ > and p z G [—1,1] be fixed and for every 
power P > let the feedback-noise variances af vl (P) and 
u^ v - 2 (P) be given, where 



lim 

P->oc 



-log(q^(P)) 
logP 



<o, i/e{i,2}. 



(97) 



Since for each power P a prelog 1 is achievable even 
without feedback we have to prove 

jj— CBCNoisy.S (P, o\, (jj , Pz , <?W1 ( P ) ; °W1 ( P )) < , 



P^oo 



ilog(l + P) 



(98) 

For p 2 G (—1,1) Inequality ( |98l follows immediately from 
Corollary [2] because with noisy feedback the prelog cannot 
be larger than with noise-free feedback. (The transmitter can 
always add the feedback noise itself.) 

For p z G {—1,1} the proof of ( |98l is similar to the proof 
in Section IVII-AI In fact, following the same steps as before, 
we can conclude that for each P > 



CBCNoisy.S (P, <?l , Cr 2 , Pz, <? W1 (P) , o\y 2 (P) ) 

" 2 l0g ( 1 + min{Var(zy ,Var(zy} 



, (99) 



where here, because \p z \ = 1, the variances in d94l ) and d95l ) 
simplify to 



Var(Zi, t ) 



Var(Z^) = 



ala 2 wl (P)a 2 W2 (P) 



crl* 2 W2 (P) + a 2 2 * 2 wl (P) + ** wl (P)* 2 W2 (Py 

(100) 

^1^1 (P)^ 2 (P) 

*f* 2 W2 (P) + aW wl {P) + v 2 wl (P)* 2 W2 (P) ■ 



(101) 



The desired inequality (|98l for ,o 2 G { — 1,1} follows now 
simply by combining dWt with d99b— (1 1 1 1 > . 

VIII. Scheme and Proof for the if-usER AWGN BC 
with Noise-Free Feedback 

A. A Scheme for the special case rank(K 2 ) = 1 

We generalize the coding scheme in the previous section to 
K > 2 users. Here, we focus on the special case where the 
noise co variance matrix K z has rank 1, which suffices to prove 
the achievability of Theorem [6] The scheme is however easily 
extended to general covariance matrices. 

To make the description of the scheme more intuitive, we 
rewrite the channel law in ( f29b in an equivalent form. Since 
K z is of rank 1, ( 1291 is equivalent to 

Y k ,t = Xt + a k Zo t t, te{l,...,n}, (102) 

where {^o,t} is an HD zero-mean Gaussian sequence of 
variance 1, and where 

a k = sign( j oi !fc )cr fc , k G {1, . . . , K}; 

here p\ >k denotes the correlation coefficient (either —1 or 1) 
between Z\ tt and Z k j and a k is the positive root of a\. 

We now describe the scheme. It has the following parame- 
ters: the positive integer number rj; the r]-by-r] strictly lower- 
triangular matrices Bi,...,Bjc; the //-dimensional column- 
vectors u%,...,Uk\ and the //-dimensional row-vectors 

Vi,...,VK. 

1) Code Construction, Encoding, Decoding: Code con- 
struction, encoding, and decoding procedures are as described 
in Section [VI- Al with the only difference that now the param- 
eter k runs from 1,...,K, 

Thus, in each subblock i G {1, . . . , n'} the transmitter sends 
the channel inputs 



K 



K 



(103) 



k=l 



fc=l 



where Z 0)i = {Z ^_ 1)v+1 , . . . , Z ^ n ) J , and Receiver k G 
{1, . . . , K} observes the channel outputs 

Y fc)i = ^k,tu k + I Bk>a k > + \a k J Z ,i, (104) 

k' = l \k' = l / 

where Y kyi = (y fei(i _ 1)n+1 , . . . , Y k , i71 ) J . The channel input 
sequence satisfies the average block-power constraint (0 
whenever Inequality ( 11051 shown on top of the next page is 
satisfied. 
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K 

E 

k=X 



Ufc 



tr 



A" 



Vfc=l 



A' 



J] B k a k Yl B k a * ))<VP 



(105) 



2) Choice of Parameters: For every positive integer 77 we 
present a relatively simple choice of parameters such that 

(i) each vector is orthogonal to the first 77 — 1 columns 

of the matrix (X^'=i Bfe'^fc' + la fc) ; 

(ii) each vector is orthogonal to the vectors 
vi, . . . ,Vfc_i, v fe+ i, . . . , v K but not to v fc ; 

, 7J-K 

(iii) the inner product v k u k equals V P times a constant 
that does not depend on P, 

and such that the power constraint d!05t is satisfied for all 
sufficiently large 77 and all powers P> 10 

Notice that with such a choice, by (i) and (ii), the "new 
outputs" formed at Receiver k are of the form 



Ik, 



II) ■ 



(106) 



and thus correspond to the outputs of a point-to-point chan- 
nel where the transmitter only sends the desired codeword 
(Efe 1, . . . ,Hfc By (iii) this point-to-point channel has 
prelog 1? ~~ ft " , and thus prelog 1 when 77 — > 00. 

To present our choice, we need the following two defini- 
tions. Define for each k G {l,...,K} the if -dimensional 
column-vector 



Oik = (1 



(107) 



a k a k a k ... Ufc 

Let now w k be the projection of the vector otk on the span 
of {oti, . . . , ttfc-i, Q!fe+i, ctA'}, and define the /^-dimensional 
row-vector 

A / a fc - w fc \ 
w fe = T — . (108) 

If ai,..., are all different and not equal to 0, then 
the vectors {oLk] k =i are linearly independent and for each 
k G {1, ...,K} the vector 7^ is orthogonal to 
{ai, . . . , afc-ijCtfe+i, . . . , ax} but not to a k . 

Now, for given positive integer 77, choose the matrices 
Bi, . . . , Bk such that 

K 
k=l 

where B is defined in (ISTt , and choose for k € {1, . . . , K} 



u k = 



Vfe 



rj-1 



Wfe, A 



7J-2 



v7£ 



1 



0) 
(HO) 

(111) 



where Wfcj denotes the j-th entry of the vector Wfe. 

This choice has the desired properties (i)-(iii), and in 
particular it satisfies (iii) because 

v fc u fe = — — — ctfcWfc, (112) 



n 



7/-1 



where w^ccfc > is a constant that neither depends on P nor 
on 77. 

3) Achievable Rates: Combining ( 1 1 06b — dTT2b . we con- 
clude the following. Our scheme achieves all rate tuples 
. . . , Rk) that simultaneously satisfy 

Rt <-L, oe ( 1 + ^-'W ), * 6{1 ,... lJr} . 

(113) 

Letting 77 — > 00 we obtain the following. 

Proposition 12: If a\, . . . , ajf are all different, and P > 1 
the rate-tuple (i?i, . . . , Rk) satisfying 

R k <\\og + (Jp) , fce{i,...,#} (114) 

is achievable. 

B. Proof of Theorem |6] 

By the definition of n a there are only n a different channels 
and therefore the prelog cannot exceed n a . 

If n a = K, then otx,...,aK in (1102b are all different, 
and the achievability of prelog n a follows directly from 
Proposition Q~2] If n a < K, then we pick n a receivers such 
that the corresponding rows of K 2 are all different. We then 
apply the scheme in the previous section to only these n a 
receivers (and ignore the other receivers). By Proposition [12] 
this scheme achieves the desired prelog n a to the selected 
receivers. 

IX. Scheme and Proofs for the AWGN IC with 
One-Sided Feedback 

A. A Scheme 

We present a block-scheme similar to the scheme for the 
two-user broadcast channel in Section [VI-A| Our scheme takes 
the same parameters as the scheme in Section [VI- A| a positive 
integer number 77, two strictly lower-triangular rj-by-rj matrices 
Bi and B2, two 77-dimensional column-vectors ui, 112, and two 
77-dimensional row-vectors vi,V2. 

1) Code construction, Encoding, Decoding: The code 
construction and the decoding procedures are the same as for 
the two-user broadcast scheme in Section [VI- AI The encoding 
procedure differs because here there are two transmitters. 

As before, for k £ {1, 2} let S k (M k ) denote the codeword 
in C k corresponding to Message M k , and let Hfc,t denote its 
i-fh symbol. Let for each k G {1, 2} the 77-length vectors 
Y k i and Z k j be defined as before, and similarly, define for 

fee {1,2} 



i-l)T7+l) • ■ • , ^k,(iri)Y ■ 



(115) 



5 A choice of parameters that satisfies the average block-power constraint for 
all powers P > and exhibits the same asymptotic performance as ! r) — > 00 
is obtained by appropriately scaling the vectors {uj.}. 



Transmitter k G {1,2} performs the following encoding 
procedure. It picks codeword S k (M k ) and in each subblock 
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i G {1, . . . , n'} it sends a linear combination of the i-th symbol 
of this codeword and the past feedback signals observed in this 
subblock: 



X 2 j 



Ui^i,. 



Bi(ai^ 2 X 2 .i 
62(12,1X1,; 



Z M ) (116a) 
Z a ,i). (116b) 



2) Choice of Parameters: We only present a choice of 
parameters for the case where p z G { — 1,1}. In this case 
%2,t = Pz^[Zi t , and we can rewrite the channel outputs at 
Receiver 2 as 



a 2 

Y2,t = 02,ili jf + a 2 . 2 X 2it + p z — Zi t t, 

0-1 



(117a) 



We fix a positive integer 77, and choose B 2 the all-zero 
matrix and 



Bi = 



/ 

VP 







V 






VP 







VP 









With this choice, by ( II 16ab and (1117b . 

Y M = aiaUiSi^ + ai i2 (a M Bi 
+(ai ;1 Bi + l)Z M 

and 



\ 





J 



l)u 2 ^ 2 



(118) 



and 



hi 



Pa 2 , 



n-i 



Pz°~2 



a.2,2 — 0,1,2- 



PzO~2 

0-1 



■=■2,* 



02 „ 

Pz £l,in- 

<?1 



Again, each receiver uses its last 77 — 2 outputs of each 
subblock to iteratively cancel the previous noise symbols in 
this subblock. Moreover, the "new outputs" i^i, . . . , I\ >n > do 
not depend on 5 2) i, . . . , 3 2) „/ but only on Si 1, . . . , Si „', and 
similarly, the "new outputs" I 2 ,i, ■ ■ . , I 2 ,n' do not depend on 
Hi,!, ■ ■ . ,Si, n / but only on H 2 ,i, ■ ■ ., 5 2,n'- 

3) Achievable Rates: For every 77 G Z + our scheme 
achieves all nonnegative rate pairs that satisfy 



1 , / P^a\\ o\ 



* 2 <i-log 1 



a 2 , 2 




Taking the limit 77 —> 00 leads to the following. 

Proposition 13: When and are both different from 

1 ai.i 01,2 



Pzf 1 , then all rate -pairs satisfying 



i?i < - log 



R 2 < - loe 



<4,iP 



(119) 



(120) 



Y 2:l = a 2 ,iUi3i,i + (a 2j iai j2 Bi + a 2>2 l)u 2 !B 2>i 
o~ 2 \ 

a 2 .iBi + p z — I Zi j. 
CT i / 

We now choose the vector vi to be orthogonal to the first 
(77 — 1) columns of the matrix (01,1 Bi + 1); v 2 to be orthogonal 
to the first (77 — 1) columns of the matrix (a 2 ,iBi+/3 z 2a|); the 
vector Ui to be orthogonal to v 2 but not to Vi, and the vector 
u 2 simply not orthogonal to (a 2 ,iai >2 Bi + a 2)2 l)v 2 . Such a 
choice is: 



,iVP 




-ax,iVP 



n-2 



v 2 = l( T ' STI 1 



Pz<?2 



-ai,lVP 
-a 2 ,iVP 

Pz&2 



The chosen ui,u 2 ,Bi,B 2 satisfy the average power con- 
straints ( [34-b at Transmitters 1 and 2 whenever P and 77 are 
sufficiently large. Moreover, 



h. 



Pal 



Pa 



n-i 



1.1 



Pa^ 



cri 



1 - 



a 2 ,ici 
ai,ip z cr 2 



ai,i^i, 



are achievable. 

Note 9: Exchanging the roles of the two transmitters we 
obtain: when and 2^ are both different from E*22. then 

Oii^i ai,2 o\ 

all rate-pairs satisfying 



Ri < ^ !og + 



fl 2 < 2 lo § 



(121) 
(122) 



are achievable. 

Note 10: With the proposed choice of parameters our 
scheme achieves prelog 2 when and are both different 

1 ai,i ai,2 

from Pzf 2 - and when 77 — > 00. For fixed 77 the scheme achieves 
a prelog of 2 Thus, choosing 77 = 3 suffices to achieve a 
prelog larger than 1 . 

Note 11: For a symmetric setup where a,^ = a 2 2 and 
fl i, 2 = fl 2 ,i the achievability of d36i l can also be shown 
using a slight generalization of Kramer's memoryless LMMSE 
scheme 1T4| . see ifTTTl . 



B. Proof of Theorem [8] 

Relation d37l ) follows from the following more general 
relation. Irrespective of the channel parameters the prelog 
satisfies 



1 < Tim" C ^MP^ 2 i,4,Pz) < 2 

~ P^oo I log(l + P) 
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The lower bound in J 123b can be achieved, e.g., by silenc- 
ing Transmitter 1 and letting Transmitter 2 communicate its 
Message M 2 to Receiver 2 over the resulting interference- 
free AWGN channel Y 2 . t = a 2 . 2 X 2 ^ + Z 2 .t at a rate R 2 = 
\ log ^1 + < ~r- \. The upper bound can be derived using 
the cutset bound and the entropy maximizing property of the 
Gaussian distribution under a covariance matrix constraint. In 
fact, applying two cuts between both transmitters and each of 
the two receivers yields the following upper bounds 



Rk < ~ log ( 1 



Kil + \ak,2\) 2p 



fee {1,2}, 



which establish the converse result in ( 1123b . 

We next prove Equation J35t . The achievability follows 
directly from the general relation ( 11231 ). When p z e { — 1,1} 
and = 2^ = sign (p z ) 2a -, the converse follows because 

Ol,l 11.2 ° 

in this case 



Y u = sign(p*) — Y 2 , u t€{l, 
o 2 



.,71 



}, (124) 



and thus, each receiver can reconstruct the other receiver's 
outputs. Consequently, the feedback capacity of our AWGN 
IC coincides with the feedback capacity of the AWGN MAC 
from both transmitters to one of the two receivers, and its 
prelog is 1 |26|. 

To prove the converse to fl35l ) when p z £ (—1,1) we use 
a genie-argument and a generalized Sato-MAC bound |27) , 
similar to the upper bounds in (J2H1 Section V-B], (29), ED, 
[31 1. Our proof consists of the following three steps. In the first 
step we let a genie prior to transmission reveal the symbols 

U" = Z$ - 

ai,2 

to Receiver 1. This obviously can only increase the sum- 
capacity of our channel. The resulting setup will be called 
the genie-aided IC. 

In the second step, we apply Sato's MAC-bound argument 
[27 1 to this genie-aided ICO That means, we define an ap- 
propriate genie-aided MAC and show that the capacity of the 
genie-aided IC is contained in the capacity of this genie-aided 
MAC. The genie-aided MAC is obtained from the genie-aided 
IC by eliminating Receiver 2 and instead requiring that the 
only remaining receiver 1 decodes both messages M% and M 2 . 
The desired inclusion of the capacities is proved by showing 
that for any encoding and decoding strategies for the genie- 
aided IC it is possible to find encoding/decoding strategies for 
the genie-aided MAC such that the probability of error over 
the MAC is no larger than over the IC. 

We fix encoding/decoding functions for the genie-aided IC, 
and choose the encoding/decoding functions for the genie- 
aided MAC as follows. The MAC transmitters apply the same 
encoding functions as the IC transmitters. The only MAC- 
receiver decodes the pair (M 1: M 2 ) as follows: 1.) It applies 
IC-Receiver l's decoding rule to decode Message M\. 2.) It 
computes 



te{l,...,n}, (125) 



6 Unlike in Sato's setup, here both transmitters have feedback from their 
corresponding receivers. However, as we shall see, also in our setup with 
one-sided feedback we can use the same arguments. 



and 

Y? = _ ai,i!r) + 02,1-XT + U n , (126) 

Ol,2 

where M\ denotes the decoded message in 1.) and /■£ \ t 
denotes IC-Transmitter l's encoding function. 3.) It finally 
applies IC-Receiver 2's decoding rule to decode Message M 2 
based on the sequence Y 2 . 

Notice that whenever the MAC-receiver (and thus also IC- 
Receiver 1) decode M\ correctly, then X™ ~ X[\ and Y 2 n — 
Y 2 n . Therefore, whenever the IC-Receivers 1 and 2 decode 
their intended messages Mi and M 2 correctly, then so does 
the only MAC-receiver, and the probability of error over the 
MAC cannot exceed the probability of error over the IC. This 
concludes the second step. 

In the third step we show that the genie-aided MAC has 
prelog no larger than 1 . Combined with the previous two steps 
this yields the desired converse to ( f35b . Before elaborating on 
this third step, we recall that in the considered genie-aided 
MAC the channel law is 



Yl, 



ai,iX 1<t + a lt2 X 2 ,t + Zn, t G {1, . . . , n}; 



the two transmitters observe the generalized feedback signals 
{li t} and {12,*}; and before the transmission starts, the 
receiver learns the genie-information U n . 

We now prove that the prelog of this genie-aided MAC 
is upper bounded by 1. To this end we fix an arbitrary 
sequence of blocklength-n, rates- {R\, R 2 ) coding schemes for 
the considered MAC such that the probability of error e(n) 
tends to zero as n tends to infinity. Then, for every blocklength 
n we have: 

R\ + R 2 

1 e(n) 
< -I(M 1 ,M 2 ;Y 1 n ,U n ) + ^ 
n ' n 

= -I(M 1 ,M 2 ;Y 1 n \U n ) + ^- 
n ' n 

1 ™ 

= -E(VmI^-\^) 

t=i 

-h(Y 1 , t \Y*- 1 ,M 1 ,M 2 ,U n )) + ^ 

/ n 

1 n 

-h{Y 1 , t \Yl~\M 1 , M 2 , Yt\ U n )^ ' 1 11 ' 

1 n 

~ Y. (HYi,t\Ut) - h(Y ltt \X liU Xa,t, U t 
t=l 

1 n 

-Y^I{Y lX ,X l>u X 2>t \U t ) 

(|ai,i| + |ai, 2 |) 2 P 



< 



< ^ log 1 



Var( Z ht \Z 2 , t - 2i|Zi, t 



(127) 



where the first inequality follows by Fano's inequality; the first 
equality follows by the independence of the genie-information 
U n and the messages Mi and M 2 \ the third equality by 
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noting that the vector Y^~ x can be computed as a function 
of Mi, F/ -1 , and [7 t_1 , see dl26t ; the fourth equality follows 
because the input X\ t t is a function of the Message Mi and 
the feedback outputs Y* , and similarly .X^t is a function 
of M2 and Kj* , and because of the Markov relation 



(M 1 ,M 2 ,Yt\Y* 



■\u t -\u t 



t+i 



)-(X ltU X 2tt ,U t )-Y, 



1.1 ■ 



and the last inequality follows because the Gaussian dis- 
tribution maximizes differential entropy under a covariance 
constraint. 

Since Var(Zi jt \Z 2 ,t - sff^i,*) does not depend on P 
and is strictly positive whenever p z € (—1, 1), by ( 1127t we 
conclude that d35l l holds also when p z 6 (—1,1). 

The converse to d36b follows from the general Rela- 
tion ( 1123b . and its achievability from Proposition [13] (Sec- 
tion ES. 
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Appendix A 
Proof of LemmaQ] 

Let 7] € Z+. If 1 + C > £, then 

i io g (i + r '- i o < ^ io g (i + (1 + cr^o 

^ log (d+cr- ((i +0^-1) ) 



>0 



<- log ((1 + 0") 

= ~log(l + 0- 
Otherwise, if 1 + ( < £, then 

i- io g (i + f- x o < ^ iog(i + zrHt - 1)) 
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